Pandas Profiling Report

Dataset statistics

Number of variables	11
Number of observations	16512
Missing cells	158
Missing cells (%)	0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	1.4 MiB
Average record size in memory	88.0 B

Variable types

Numeric	10
Categorical	1

Alerts

`longitude` is highly correlated with `latitude`	High correlation
`latitude` is highly correlated with `longitude`	High correlation
`total_rooms` is highly correlated with `total_bedrooms` and 2 other fields	High correlation
`total_bedrooms` is highly correlated with `total_rooms` and 2 other fields	High correlation
`population` is highly correlated with `total_rooms` and 2 other fields	High correlation
`households` is highly correlated with `total_rooms` and 2 other fields	High correlation
`median_income` is highly correlated with `median_house_value`	High correlation
`median_house_value` is highly correlated with `median_income`	High correlation
`longitude` is highly correlated with `latitude`	High correlation
`latitude` is highly correlated with `longitude`	High correlation
`total_rooms` is highly correlated with `total_bedrooms` and 2 other fields	High correlation
`total_bedrooms` is highly correlated with `total_rooms` and 2 other fields	High correlation
`population` is highly correlated with `total_rooms` and 2 other fields	High correlation
`households` is highly correlated with `total_rooms` and 2 other fields	High correlation
`median_income` is highly correlated with `median_house_value`	High correlation
`median_house_value` is highly correlated with `median_income`	High correlation
`longitude` is highly correlated with `latitude`	High correlation
`latitude` is highly correlated with `longitude`	High correlation
`total_rooms` is highly correlated with `total_bedrooms` and 2 other fields	High correlation
`total_bedrooms` is highly correlated with `total_rooms` and 2 other fields	High correlation
`population` is highly correlated with `total_rooms` and 2 other fields	High correlation
`households` is highly correlated with `total_rooms` and 2 other fields	High correlation
`df_index` is highly correlated with `longitude` and 3 other fields	High correlation
`longitude` is highly correlated with `df_index` and 3 other fields	High correlation
`latitude` is highly correlated with `df_index` and 3 other fields	High correlation
`total_rooms` is highly correlated with `total_bedrooms` and 2 other fields	High correlation
`total_bedrooms` is highly correlated with `total_rooms` and 2 other fields	High correlation
`population` is highly correlated with `total_rooms` and 2 other fields	High correlation
`households` is highly correlated with `total_rooms` and 2 other fields	High correlation
`median_income` is highly correlated with `median_house_value`	High correlation
`median_house_value` is highly correlated with `df_index` and 4 other fields	High correlation
`ocean_proximity` is highly correlated with `df_index` and 3 other fields	High correlation
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique

Reproduction

Analysis started	2022-07-10 20:18:28.876997
Analysis finished	2022-07-10 20:18:44.361380
Duration	15.48 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIFORM
UNIQUE

Distinct	16512
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10331.45452

Minimum	0
Maximum	20638
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	0
5-th percentile	1027.55
Q1	5157.75
median	10339.5
Q3	15521.25
95-th percentile	19628.45
Maximum	20638
Range	20638
Interquartile range (IQR)	10363.5

Descriptive statistics

Standard deviation	5979.056892
Coefficient of variation (CV)	0.5787236329
Kurtosis	-1.207383237
Mean	10331.45452
Median Absolute Deviation (MAD)	5182
Skewness	-0.003143328072
Sum	170592977
Variance	35749121.32
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3435	1	< 0.1%
3371	1	< 0.1%
13612	1	< 0.1%
15661	1	< 0.1%
9518	1	< 0.1%
17714	1	< 0.1%
19763	1	< 0.1%
5432	1	< 0.1%
7481	1	< 0.1%
Other values (16502)	16502	99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
20638	1	< 0.1%
20637	1	< 0.1%
20636	1	< 0.1%
20635	1	< 0.1%
20634	1	< 0.1%
20633	1	< 0.1%
20632	1	< 0.1%
20630	1	< 0.1%
20629	1	< 0.1%
20628	1	< 0.1%

longitude
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	825
Distinct (%)	5.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-119.5756353

Minimum	-124.35
Maximum	-114.31
Zeros	0
Zeros (%)	0.0%
Negative	16512
Negative (%)	100.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	-124.35
5-th percentile	-122.47
Q1	-121.8
median	-118.51
Q3	-118.01
95-th percentile	-117.07
Maximum	-114.31
Range	10.04
Interquartile range (IQR)	3.79

Descriptive statistics

Standard deviation	2.001828066
Coefficient of variation (CV)	-0.01674110332
Kurtosis	-1.334715391
Mean	-119.5756353
Median Absolute Deviation (MAD)	1.29
Skewness	-0.2935554126
Sum	-1974432.89
Variance	4.007315604
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-118.31	133	0.8%
-118.3	129	0.8%
-118.29	121	0.7%
-118.27	113	0.7%
-118.35	113	0.7%
-118.28	107	0.6%
-118.19	107	0.6%
-118.14	101	0.6%
-118.36	101	0.6%
-118.26	99	0.6%
Other values (815)	15388	93.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-124.35	1	< 0.1%
-124.3	2	< 0.1%
-124.27	1	< 0.1%
-124.26	1	< 0.1%
-124.25	1	< 0.1%
-124.23	3	< 0.1%
-124.22	1	< 0.1%
-124.21	3	< 0.1%
-124.19	4	< 0.1%
-124.18	5	< 0.1%

Value	Count	Frequency (%)
-114.31	1	< 0.1%
-114.47	1	< 0.1%
-114.49	1	< 0.1%
-114.55	1	< 0.1%
-114.57	2	< 0.1%
-114.58	2	< 0.1%
-114.59	2	< 0.1%
-114.6	1	< 0.1%
-114.63	1	< 0.1%
-114.64	1	< 0.1%

latitude
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	839
Distinct (%)	5.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	35.63931444

Minimum	32.54
Maximum	41.95
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	32.54
5-th percentile	32.82
Q1	33.94
median	34.26
Q3	37.72
95-th percentile	38.95
Maximum	41.95
Range	9.41
Interquartile range (IQR)	3.78

Descriptive statistics

Standard deviation	2.13796281
Coefficient of variation (CV)	0.05998888709
Kurtosis	-1.11725371
Mean	35.63931444
Median Absolute Deviation (MAD)	1.23
Skewness	0.4614558848
Sum	588476.36
Variance	4.570884976
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
34.06	207	1.3%
34.05	193	1.2%
34.07	191	1.2%
34.08	191	1.2%
34.02	169	1.0%
34.09	169	1.0%
34.04	164	1.0%
34.1	158	1.0%
34.03	152	0.9%
33.97	147	0.9%
Other values (829)	14771	89.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
32.54	1	< 0.1%
32.55	2	< 0.1%
32.56	8	< 0.1%
32.57	15	0.1%
32.58	20	0.1%
32.59	10	0.1%
32.6	9	0.1%
32.61	14	0.1%
32.62	12	0.1%
32.63	15	0.1%

Value	Count	Frequency (%)
41.95	1	< 0.1%
41.92	1	< 0.1%
41.88	1	< 0.1%
41.86	3	< 0.1%
41.84	1	< 0.1%
41.81	1	< 0.1%
41.8	3	< 0.1%
41.79	1	< 0.1%
41.78	2	< 0.1%
41.77	1	< 0.1%

housing_median_age
Real number (ℝ_≥0)

Distinct	52
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	28.65340359

Minimum	1
Maximum	52
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	1
5-th percentile	8
Q1	18
median	29
Q3	37
95-th percentile	52
Maximum	52
Range	51
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	12.57481861
Coefficient of variation (CV)	0.4388595085
Kurtosis	-0.7967859407
Mean	28.65340359
Median Absolute Deviation (MAD)	10
Skewness	0.0594681207
Sum	473125
Variance	158.1260632
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
52	1027	6.2%
36	696	4.2%
35	668	4.0%
16	626	3.8%
17	562	3.4%
34	557	3.4%
33	504	3.1%
26	491	3.0%
25	458	2.8%
32	449	2.7%
Other values (42)	10474	63.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	3	< 0.1%
2	46	0.3%
3	51	0.3%
4	150	0.9%
5	188	1.1%
6	131	0.8%
7	139	0.8%
8	166	1.0%
9	163	1.0%
10	212	1.3%

Value	Count	Frequency (%)
52	1027	6.2%
51	39	0.2%
50	106	0.6%
49	108	0.7%
48	146	0.9%
47	152	0.9%
46	180	1.1%
45	238	1.4%
44	268	1.6%
43	289	1.8%

total_rooms
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	5494
Distinct (%)	33.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2622.539789

Minimum	6
Maximum	39320
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	6
5-th percentile	624.55
Q1	1443
median	2119
Q3	3141
95-th percentile	6187.8
Maximum	39320
Range	39314
Interquartile range (IQR)	1698

Descriptive statistics

Standard deviation	2138.41708
Coefficient of variation (CV)	0.8153992894
Kurtosis	31.6770306
Mean	2622.539789
Median Absolute Deviation (MAD)	799
Skewness	4.000835511
Sum	43303377
Variance	4572827.61
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1527	16	0.1%
1582	15	0.1%
1471	14	0.1%
1705	13	0.1%
1462	13	0.1%
1613	13	0.1%
1283	12	0.1%
1703	12	0.1%
1745	12	0.1%
2053	12	0.1%
Other values (5484)	16380	99.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
6	1	< 0.1%
15	2	< 0.1%
16	1	< 0.1%
18	2	< 0.1%
19	2	< 0.1%
20	1	< 0.1%
21	1	< 0.1%
22	1	< 0.1%
24	1	< 0.1%
25	1	< 0.1%

Value	Count	Frequency (%)
39320	1	< 0.1%
37937	1	< 0.1%
32054	1	< 0.1%
30450	1	< 0.1%
30401	1	< 0.1%
28258	1	< 0.1%
27700	1	< 0.1%
25135	1	< 0.1%
23915	1	< 0.1%
23866	1	< 0.1%

total_bedrooms
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1810
Distinct (%)	11.1%
Missing	158
Missing (%)	1.0%
Infinite	0
Infinite (%)	0.0%
Mean	534.9146386

Minimum	2
Maximum	6210
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	2
5-th percentile	137
Q1	295
median	433
Q3	644
95-th percentile	1268
Maximum	6210
Range	6208
Interquartile range (IQR)	349

Descriptive statistics

Standard deviation	412.6656494
Coefficient of variation (CV)	0.7714607521
Kurtosis	19.55191916
Mean	534.9146386
Median Absolute Deviation (MAD)	162
Skewness	3.269270493
Sum	8747994
Variance	170292.9382
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
272	44	0.3%
280	44	0.3%
393	43	0.3%
328	41	0.2%
345	41	0.2%
331	41	0.2%
309	40	0.2%
394	39	0.2%
292	39	0.2%
348	39	0.2%
Other values (1800)	15943	96.6%
(Missing)	158	1.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	1	< 0.1%
3	3	< 0.1%
4	4	< 0.1%
5	5	< 0.1%
6	3	< 0.1%
7	5	< 0.1%
8	7	< 0.1%
9	5	< 0.1%
10	6	< 0.1%
11	6	< 0.1%

Value	Count	Frequency (%)
6210	1	< 0.1%
5471	1	< 0.1%
5290	1	< 0.1%
5033	1	< 0.1%
4957	1	< 0.1%
4819	1	< 0.1%
4585	1	< 0.1%
4457	1	< 0.1%
4407	1	< 0.1%
4386	1	< 0.1%

population
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	3619
Distinct (%)	21.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1419.687379

Minimum	3
Maximum	35682
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	3
5-th percentile	347.55
Q1	784
median	1164
Q3	1719
95-th percentile	3276.9
Maximum	35682
Range	35679
Interquartile range (IQR)	935

Descriptive statistics

Standard deviation	1115.663036
Coefficient of variation (CV)	0.7858512042
Kurtosis	71.79207705
Mean	1419.687379
Median Absolute Deviation (MAD)	441
Skewness	4.741568331
Sum	23441878
Variance	1244704.01
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1227	21	0.1%
753	20	0.1%
1005	20	0.1%
891	19	0.1%
761	19	0.1%
825	19	0.1%
1056	18	0.1%
986	18	0.1%
662	18	0.1%
1011	18	0.1%
Other values (3609)	16322	98.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
3	1	< 0.1%
8	3	< 0.1%
9	2	< 0.1%
11	1	< 0.1%
13	2	< 0.1%
14	3	< 0.1%
15	2	< 0.1%
17	2	< 0.1%
18	1	< 0.1%
19	1	< 0.1%

Value	Count	Frequency (%)
35682	1	< 0.1%
16305	1	< 0.1%
16122	1	< 0.1%
15507	1	< 0.1%
15037	1	< 0.1%
13251	1	< 0.1%
12427	1	< 0.1%
12203	1	< 0.1%
11973	1	< 0.1%
11272	1	< 0.1%

households
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1691
Distinct (%)	10.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	497.0118096

Minimum	2
Maximum	5358
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	2
5-th percentile	124
Q1	279
median	408
Q3	602
95-th percentile	1150
Maximum	5358
Range	5356
Interquartile range (IQR)	323

Descriptive statistics

Standard deviation	375.6961563
Coefficient of variation (CV)	0.7559099182
Kurtosis	19.29465292
Mean	497.0118096
Median Absolute Deviation (MAD)	150
Skewness	3.222081325
Sum	8206659
Variance	141147.6019
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
429	47	0.3%
335	47	0.3%
386	45	0.3%
306	45	0.3%
316	44	0.3%
278	44	0.3%
375	43	0.3%
297	42	0.3%
340	42	0.3%
284	42	0.3%
Other values (1681)	16071	97.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	1	< 0.1%
3	3	< 0.1%
4	3	< 0.1%
5	5	< 0.1%
6	4	< 0.1%
7	6	< 0.1%
8	7	< 0.1%
9	8	< 0.1%
10	7	< 0.1%
11	3	< 0.1%

Value	Count	Frequency (%)
5358	1	< 0.1%
5189	1	< 0.1%
5050	1	< 0.1%
4769	1	< 0.1%
4339	1	< 0.1%
4204	1	< 0.1%
4176	1	< 0.1%
4072	1	< 0.1%
4012	1	< 0.1%
3958	1	< 0.1%

median_income
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	10905
Distinct (%)	66.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.875884278

Minimum	0.4999
Maximum	15.0001
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	0.4999
5-th percentile	1.603355
Q1	2.56695
median	3.54155
Q3	4.745325
95-th percentile	7.308945
Maximum	15.0001
Range	14.5002
Interquartile range (IQR)	2.178375

Descriptive statistics

Standard deviation	1.904930518
Coefficient of variation (CV)	0.4914828157
Kurtosis	4.933255636
Mean	3.875884278
Median Absolute Deviation (MAD)	1.06035
Skewness	1.653352864
Sum	63998.6012
Variance	3.62876028
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2.875	38	0.2%
15.0001	38	0.2%
2.625	37	0.2%
3.125	37	0.2%
3.375	33	0.2%
3.625	32	0.2%
4.125	32	0.2%
3.875	31	0.2%
3	29	0.2%
4	28	0.2%
Other values (10895)	16177	98.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.4999	9	0.1%
0.536	7	< 0.1%
0.5495	1	< 0.1%
0.6433	1	< 0.1%
0.6775	1	< 0.1%
0.6825	1	< 0.1%
0.6991	1	< 0.1%
0.7007	1	< 0.1%
0.7025	1	< 0.1%
0.7054	1	< 0.1%

Value	Count	Frequency (%)
15.0001	38	0.2%
15	2	< 0.1%
14.5833	1	< 0.1%
14.4219	1	< 0.1%
14.4113	1	< 0.1%
14.2959	1	< 0.1%
13.947	1	< 0.1%
13.8556	1	< 0.1%
13.8093	1	< 0.1%
13.6842	1	< 0.1%

median_house_value
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	3669
Distinct (%)	22.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	207005.3224

Minimum	14999
Maximum	500001
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	129.1 KiB

Quantile statistics

Minimum	14999
5-th percentile	66400
Q1	119800
median	179500
Q3	263900
95-th percentile	494535
Maximum	500001
Range	485002
Interquartile range (IQR)	144100

Descriptive statistics

Standard deviation	115701.2973
Coefficient of variation (CV)	0.5589290938
Kurtosis	0.3342974568
Mean	207005.3224
Median Absolute Deviation (MAD)	68100
Skewness	0.9868126102
Sum	3418071883
Variance	1.338679019 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
500001	786	4.8%
137500	102	0.6%
162500	91	0.6%
112500	80	0.5%
187500	76	0.5%
225000	70	0.4%
350000	65	0.4%
87500	59	0.4%
150000	58	0.4%
175000	52	0.3%
Other values (3659)	15073	91.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
14999	3	< 0.1%
22500	3	< 0.1%
26600	1	< 0.1%
26900	1	< 0.1%
27500	1	< 0.1%
28300	1	< 0.1%
30000	1	< 0.1%
32500	3	< 0.1%
32900	1	< 0.1%
33200	1	< 0.1%

Value	Count	Frequency (%)
500001	786	4.8%
500000	23	0.1%
499100	1	< 0.1%
499000	1	< 0.1%
498800	1	< 0.1%
498700	1	< 0.1%
498600	1	< 0.1%
498400	1	< 0.1%
497600	1	< 0.1%
497400	1	< 0.1%

ocean_proximity
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	129.1 KiB

<1H OCEAN	7277
INLAND	5262
NEAR OCEAN	2124
NEAR BAY	1847
ISLAND	2

Length

Max length	10
Median length	9
Mean length	8.060380329
Min length	6

Characters and Unicode

Total characters	133093
Distinct characters	16
Distinct categories	4 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	INLAND
2nd row	NEAR OCEAN
3rd row	INLAND
4th row	NEAR OCEAN
5th row	<1H OCEAN

Common Values

Value	Count	Frequency (%)
<1H OCEAN	7277	44.1%
INLAND	5262	31.9%
NEAR OCEAN	2124	12.9%
NEAR BAY	1847	11.2%
ISLAND	2	< 0.1%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
ocean	9401	33.9%
1h	7277	26.2%
inland	5262	19.0%
near	3971	14.3%
bay	1847	6.7%
island	2	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
N	23898	18.0%
A	20483	15.4%
E	13372	10.0%
	11248	8.5%
O	9401	7.1%
C	9401	7.1%
<	7277	5.5%
1	7277	5.5%
H	7277	5.5%
I	5264	4.0%
Other values (6)	18195	13.7%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	107291	80.6%
Space Separator	11248	8.5%
Math Symbol	7277	5.5%
Decimal Number	7277	5.5%

Most frequent character per category

Uppercase Letter

Value	Count	Frequency (%)
N	23898	22.3%
A	20483	19.1%
E	13372	12.5%
O	9401	8.8%
C	9401	8.8%
H	7277	6.8%
I	5264	4.9%
L	5264	4.9%
D	5264	4.9%
R	3971	3.7%
Other values (3)	3696	3.4%

Space Separator

Value	Count	Frequency (%)
	11248	100.0%

Math Symbol

Value	Count	Frequency (%)
<	7277	100.0%

Decimal Number

Value	Count	Frequency (%)
1	7277	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	107291	80.6%
Common	25802	19.4%

Most frequent character per script

Latin

Value	Count	Frequency (%)
N	23898	22.3%
A	20483	19.1%
E	13372	12.5%
O	9401	8.8%
C	9401	8.8%
H	7277	6.8%
I	5264	4.9%
L	5264	4.9%
D	5264	4.9%
R	3971	3.7%
Other values (3)	3696	3.4%

Common

Value	Count	Frequency (%)
	11248	43.6%
<	7277	28.2%
1	7277	28.2%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	133093	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
N	23898	18.0%
A	20483	15.4%
E	13372	10.0%
	11248	8.5%
O	9401	7.1%
C	9401	7.1%
<	7277	5.5%
1	7277	5.5%
H	7277	5.5%
I	5264	4.0%
Other values (6)	18195	13.7%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	longitude	latitude	housing_median_age	total_rooms	total_bedrooms	population	households	median_income	median_house_value	ocean_proximity
0	12655	-121.46	38.52	29.0	3873.0	797.0	2237.0	706.0	2.1736	72100.0	INLAND
1	15502	-117.23	33.09	7.0	5320.0	855.0	2015.0	768.0	6.3373	279600.0	NEAR OCEAN
2	2908	-119.04	35.37	44.0	1618.0	310.0	667.0	300.0	2.8750	82700.0	INLAND
3	14053	-117.13	32.75	24.0	1877.0	519.0	898.0	483.0	2.2264	112500.0	NEAR OCEAN
4	20496	-118.70	34.28	27.0	3536.0	646.0	1837.0	580.0	4.4964	238300.0	<1H OCEAN
5	1481	-122.04	37.96	28.0	1207.0	252.0	724.0	252.0	3.6964	165700.0	NEAR BAY
6	18125	-122.03	37.33	23.0	4221.0	671.0	1782.0	641.0	7.4863	412300.0	<1H OCEAN
7	5830	-118.31	34.20	36.0	1692.0	263.0	778.0	278.0	5.0865	349600.0	<1H OCEAN
8	17989	-121.95	37.27	17.0	1330.0	271.0	408.0	258.0	1.7171	181300.0	<1H OCEAN
9	4861	-118.28	34.02	29.0	515.0	229.0	2690.0	217.0	0.4999	500001.0	<1H OCEAN

Last rows

	df_index	longitude	latitude	housing_median_age	total_rooms	total_bedrooms	population	households	median_income	median_house_value	ocean_proximity
16502	12396	-116.29	33.67	12.0	5048.0	842.0	883.0	391.0	5.6918	231300.0	INLAND
16503	16476	-121.27	38.13	35.0	2607.0	685.0	2016.0	618.0	1.7500	82900.0	INLAND
16504	2271	-119.80	36.78	43.0	2382.0	431.0	874.0	380.0	3.5542	96500.0	INLAND
16505	6980	-118.01	33.97	36.0	1451.0	224.0	608.0	246.0	6.0648	290800.0	<1H OCEAN
16506	5206	-118.28	33.93	41.0	936.0	257.0	913.0	226.0	2.0313	122600.0	<1H OCEAN
16507	15174	-117.07	33.03	14.0	6665.0	1231.0	2026.0	1001.0	5.0900	268500.0	<1H OCEAN
16508	12661	-121.42	38.51	15.0	7901.0	1422.0	4769.0	1418.0	2.8139	90400.0	INLAND
16509	19263	-122.72	38.44	48.0	707.0	166.0	458.0	172.0	3.1797	140400.0	<1H OCEAN
16510	19140	-122.70	38.31	14.0	3155.0	580.0	1208.0	501.0	4.1964	258100.0	<1H OCEAN
16511	19773	-122.14	39.97	27.0	1079.0	222.0	625.0	197.0	3.1319	62700.0	INLAND

Overview

Variables

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Uppercase Letter

Space Separator

Math Symbol

Decimal Number

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows